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(57)Abstract: 

PURPOSE: To improve the quality of a reproduced picture 
and to reduce a calculation quantity for prediction in the 
motion prediction of animation. 

CONSTITUTION: A pattern is divided into plural small blocks, 
and a current frame or a current field is compared with a 
reference frame or a reference field in the unit of blocks and a 
block in the reference frame or the reference field is used for a 
prediction block of the current block. An output signal subject 
to block processing of the current frame 4 or current field and 
the reference frame 1 or reference field is given to filters 2, 2 
having a band pass characteristic representing the visuality 
and an output of the filters is inputted to a block matching. 
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CLAIMS 



[Claim(s)] 

[Claim 1] Divide a screen into two or more small blocks, and the present frame or the present field is 
compared with a reference frame or a reference field per block. In the block matching motion presumption 
approach of a dynamic image of applying the block in a reference frame or a reference field as a 
prediction block of the present block To the output signal with which the present frame or the present field 
and the reference frame, or the reference field was blocked The block matching motion presumption 
approach of the dynamic image characterized by detecting a motion vector by covering the filter which 
has a band-pass response showing vision, and using the output of this filter as the input image of block 
matching. 

[Claim 2] The binary block matching approach which carries out binarization of the output of the vision 
filter of claim 1 , and considers it as the input of block matching. 
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DETAILED DESCRIPTION 



[Detailed Description of the Invention] 
[0001] 

[Industrial Application] This invention relates to motion presumption of the frame interpolation of a 
dynamic image, and the dynamic image in motion compensation coding and TV method conversion. 
[0002] 

[Description of the Prior Art] As a motion detection method between the frames (field) of a dynamic image, 
there is a block matching method conventionally. As shown in drawing 1 , this divides a screen into a 
small block, determines whether to be best in agreement with which part in a reference frame (field) per 
block, and applies the block of the location in the reference frame as a prediction block of the present 
block, as the criterion showing a rate in agreement — inter-frame — the minimum absolute value sum and 
the least square sum of difference are used. This technique is applied to motion compensation inter-frame 
predicting coding of an image, and the frame interpolation technique in television standards conversion. 
This technique will be Transactionsof Communication of IEEE around 1981. It is announced by the 
magazine etc. and, recently, the VLSI chip which realizes this algorithm is also manufactured. However, 
each of these is premised on carrying out direct block matching of a reference frame and the present 
frame. 
[0003] 

[Problem(s) to be Solved by the Invention] By the conventional approach, when level variation was in an 
image, or when various motions were intermingled in a block, there was a fault of having not detected the 
right motion vector visually. For this reason, when a playback image is seen, the result that degradation 
tends to be in sight is brought. Furthermore, it sets to block matching and an input image is 8 bit. Since it 
is expressed, a count load is large. 

[0004] This invention aims at decreasing the computational complexity of motion prediction while it 

improves the image quality of a playback image. 

[0005] 

[Means for Solving the Problem] This invention is the block matching motion presumption approach of a 
dynamic image characterized by to detect a motion vector by having been made in view of the above 
trouble, covering the filter which expresses vision, respectively over the frame, the field (the present 
frame or the present field) and the reference frame, or the field where the present block belongs, and 
making them into the input image of block matching in it in the block matching method which is a motion 
detection method between inter-frame [ of this image ], or the field. Hereafter, it explains to a detail. 
[0006] 

[Principle of the Invention] Using what carried out formula modeling of human being's vision, beforehand, 
each frame asks for how it is visible to human being's vision, and carries out block matching based on it. 
Furthermore, a count load can be reduced if binarization of the input of block matching is carried out. 
[0007] First, the filter which expresses vision with the present frame (field) and a reference frame (field), 
respectively is covered. This is expressed with the following formula. 
[Equation 1] 

O (i, j) = (G** ( i, j) -G in (i ( (i, J) «• (1) 

<^ K- 

G e * (1, j) = A 2 exp C- (i 2 + j 2 ) /2a 2 ]-(2) 
G in ( i, j) =exp [- (i 2 + j 4 ) o 8 ]"'(3) 

In a formula (1), I (i, j) is a pixel value in the coordinate in an input image (i, j). 

[External Character 1] 

® 



********** is expressed. O (i, j) is the output of a filter. The output image which is the set of O (i, j) serves 
as an input to block matching. Gex-Gin is a DOG function and this serves as reasonable good 
approximation which expresses the receptive field of a retina at the time of lambda= 1.6. sigma is related 
to the resolution of an eye, and resolution becomes coarse, so that sigma is large. 

[0008] Next, the frame (field) after letting a vision filter pass is used as the input frame (field) of block 
matching, block matching is performed, and the motion vector for every block is detected. Or binarization 
of the output by the formula (1) is carried out from positive/negative, and this is considered as the input of 
block matching, and suppose after that that it is the same. 
[0009] 

[Example] Drawing 2 is the block diagram of "motion presumption using a vision filter" explained for the 
preceding clause. Among drawing, except the part enclosed with a dotted line, it is a Prior art and it is a 
new point to insert the dotted-line section. The thing which carried out binarization of the vision image, 
then the block matching section 6 can be simplified among drawing. That is, it is made to 1 bit operation 
instead of 8 bit operations. 

[0010] In a block matching method, one screen is divided into the block of a certain size, and it 
investigates whether it is most in agreement with which part in a reference image about each block. In 
that case, total of the sum of squares chooses the smallest location. Make a block size into **32 pixel x16 
line, and let retrieval range be **16 pixels wide and the length of **eight lines. This is a Prior art. 
[0011] In this invention, the filter 2 which expresses a vision model with the frame 4 to which the present 
block belongs, and the reference frame 1 is covered, and the image (binarization image) 3 of the result 
and 5 perform block matching 6. The algorithm of the motion detection in the case of block matching is 
performed for example, with all heuristics (all the reference blocks of retrieval within the limits are 
investigated). 

[0012] Specifically, the vision filter 2 expressed with a formula 1 turns into a filter like drawing 3 . In order 
that this filter may have a band-pass response and may cut an in one direction flowed part, 3 and 5 take 
the value of positive/negative as a result of the formula (1) which collapsed this in the input image. 
Although it is good also as an input of block matching as it is in this, if block matching is carried out after 
carrying out binarization of this corresponding to positive/negative, the arithmetic circuit of the block 
matching unit 6 can be simplified from 8 bit operations to 1 bit operation. 

[0013] Hereafter, a motion vector is searched for with a block matching method. This is the same as the 

conventional approach. 

[0014] 

[Effect of the Invention] In the motion detection by block matching, if this invention using human being's 
vision model is used, even when level variation and various motions in a block are intermingled, in the 
image after the frame interpolation of a dynamic image, and a low bit rate motion compensation image 
and TV image after method conversion, a natural prediction image will be obtained visually. A flicker, the 
fine motion within the block which is visually uninfluential, etc. depend this on the reason the effect affect 
block matching is removable, by covering a vision filter. Furthermore, structure of a block matching unit 
can be simplified by carrying out binarization of the output of a vision filter. 

[0015] Drawing 4 expresses the error of the detection motion vector by the conventional approach and 
the approach using a vision filter about an image with level variation. The error is concentrating [ the way 
which used the vision filter ] on 0, and it turns out that it is a good property. 



(19>B*H4MWt (JP) (12) ^ 1 41 1^ i (A) <ll)1*WffiB&BH» 

#S§¥6- 113266 

(43) 0 ¥i£ 6 ¥ (1994) 4 J? 22 B 



*mb*» jti^sa#^ fi mm^mm 

Z 9187-5C 
A 

4 1 0 8837 - 5L 
Z 





*&g¥4-279283 




000001214 














(22)WBiB 


^4^(1992) 9 ^25 9 




*asmmtt.mi& 2 t b 3 3 


12^ 








/II BB 










*m£E$t® I2g#r ® 2TB 31 


















at) tm A 


#a± m* *- 





<54) [nno^ft] tt^TfrGmtoimmmtoynypvyf-ymzmsEm 



(57) [SUM 

£ LT#R57 AX^#R87>f — ;H^f*3©^D y £ £ 
S T H 86 S Kffl«© ^ D y $ V y ^ > IfWt fc 
*V»T. S71/-A (4) XteS^-JH^ *5±tf# 
flg^L'-A (1) X^ra^-J^CD^Dy^teStl 

female. «*ftm'«*ffiwrae#-r*7-f .fr 

^ (2, 2) sa^t, ji^roffiasr/py^vy 
=?y>? (6) oAJiw&t-rz. 



(51) IntCl. 5 

H0 4N 7/00 

G 0 1 P 13/00 

G 0 6 F 15/70 

H04N 7/137 



r 










! / 2 














1 . 


















, 6 
















1 










m 




ft* 






























^_ 









ft^SJU - — 1 



—591— 



(2) 



#B3^6-1 1 32 6 6 



v i/^mzmy i/-ax»I7^ —a> v &&my u~a 

S7 ^ m^j £ y # v v =?■ yif(D A7JH& it- 
si: £fc<t;D, h*fi«fflf«iitfiw«tr 

U J £ft*y't2yWy<?>'>f<DAJ]tTZ>~ti.y'Uy 
[0 0 0 1] 

[0 0 0 2] 

[fi£*©Sffi] »H«©7k-A <7^-;H<) W©f& 

SJU ^□yi'*ffifc#l7|/-A ft© 
^©^Sfl^Py^tL-T, ^©#^71^— AF*3(D-?-<Df4: 
*t-*IJfeS^t UT(J> 7W-A|lflg#ffl*/h*fi*Hlft 

&tt%yu-&to#Mfi\zfomzn-i:^5>. z\<n$mu 

19 8 l^lt-tel EEE©Transactionsof Communica 
tion ^^:t*fc5§ig$nT*D> »JET?H:2i<Dr^U 
O (i, j) =* (G'* (1, j) 

<w Lb 



[0 0 0 3] 

mfc&M.Z-'p-r^h^oM&iZfciT^&o 
10 3 61:, ^nyirvy^^fc^HT. A**«fJ8 bi 

[0 0 0 4] *9&9!tt¥?£Hfk©HK£afe8 , *~«£:# 

fc, »*^w©tfj«fc*^*i«££ftBWfc*r«. 

[0 0 0 5] 

^ H W©»i*tfclij7?5ST<& « ? □ v t> T y ^ >ifm fc* 

*. 

[0 0 0 6] 

[0 0 0 7] s-f, a^i^-A O^-^F) 

**>tt*. una, wits, &©5£T«3n5. 
ni] 

e 

-G in (i. (i, J) «. (1) 



G"(i, j)=r ex P [- (i 2 +j a ) /2a 2 ] - (2) 
G in (i, j) =exp [- (i a +J *) /2\* o* ]•» (3) 
a, K : SIC 



5£ (1) t*HT, I (i, j) H:AftlB*>f>©£W 
(1, j) t*«-*BMS|lTJ*5. 
Wl] 

® 

*. O (1, j) ©ft-&T?*Sffl*lH«3{ft, 7"Dy?V 50 



d, ^n»A = i. 6©«ffcjfflM©s§»&aa-r5fe 

[0 0 0 8] if7^;^SI[/fct07k-A 

(7^— ;n«) ®, yny^yf-yyvx-hyv—hi 
(yj—)VY) y*xiyt>^y^yV%ft\^ ya 



—592— 



(3) 



#B3^6-1 1 32 6 6 



(l) £ c k5fii#£iEA<fcr)-tt'fbU ^n^n-yif 
[0 0 0 9] 

at?*, stfy h«urm&<, 1 1;* nwurc* 
[ooio] ^By^vyf^STii, liBEsa&s 
MIW©2©*#fcte:3£fcHOT*>0ft«fl't6. ^© 

ny^iMXte, fctAfcl, + 3 2Bji£x 1 6 ><£: 

[0 0 11] *389lTtt, 3I:/n y 7 A 

ft*»tt. <a>—mtemm 3, 5£5u 

•5. 

[0 0 12] sn?asn5at7^M2ii ) JM£6<) 
[Ctt, '0S|^fig|3cZ)J:3?S:7>i';i/5'tft:S„ t©7^A 

*tt#^«ttft**LiMt#s;&y h-r«fc«, eft 

ftA.*W«fcft*&A/tf5S (1) ©*i!Jft3, 5KIEA© 

h 6 ©SMStaJKrS 8 Hy MWW> 6 1 tfy hflW'sifB 
[0 0 13] .BAT, ^B?if75»f>^ftt±!), »"« 



[0 0 14] 

[3!W©«r*] ^n.y?7» / ,f>^|;«t5»ft[H!lj5 

7-fM*sJ>»«Cifci5, 7 'J y 

V>!/n y £? F*J©^> Vift^ft £*t^n y #V y > 

[0 0 15] l^;VS»©&SW&t~O^T, 

[0ffi©ffi¥&iBef!] 
a? [Hi] T/ny^y^irttwaiasrewu&HTr* 

[02] *»W©a*7-<^tfflH&»Pl«0^ny 
[03] a7W-At#JIB7l'-AC*W-*«3t7-f/l' 

^©#l£^t"0T£.5. 

[04] WOWgttOfcSHfcfc^T, fi!5fe©**2: 

50 [flF*©ftNg] 

1 #B87U- A 

2 mj£74JMr9 

3 #S87W-A©ia«B« 

4 Si? V— A 

5 AOWJtffl* 

6 *7uy>rwf->!f& 



imi] 



[02] 



ii« 



JR-3I/-Zi 



.2 3 



ft* 



lanes* 



—593— 



»M¥6- 1 13 2 6 6 



-3, ^4. .<>. -8 . -9,-11,-12.-14.-14.-14,-14,-14.-12.-11. -9. -ft -S. -4. -3. -2. 
-4. -G. -&. -10. -13. -15, -16, -17. -17. -18. -17. -17. -16. -15. -13.-10, -S- -6. -4, -3. 
-6. -8,-11.-14.-16.-17.-18.-18.-18.-18.^18,-18.-18.-17.-16.-14.-11. -S. -6. -4. 
-8. -lO. -14. -16. -18 .-18. -17. -14. -12, -11 .-12 . -14 . -17 .-18 . -18 . -16 .-14.-10, -8. -S . 
-9. -13. -16. -18. -18. -IS. -9. -2. 4. 6. 4. -2. -9- -IS ,-18 .-IB. -IS .-13. -9, -6. 
A -11 .-15. -17. -IS. -IS. -7. 6. 19. 30. 35, 30. 19. 6. -7 .-IS .-IS, -17. -15. -11 -8. 

-12. -16. -13.-17. -9. 6. 27, 43. 66. 73. 66. 49, 27. 6. -9.-17,-18.-16.-12. -9. 
-14.-17^18.-14. -2. 19. 49. SO. 104. 113 .104 . SO, 49. 19. -2 . -14, -IS .-17 ."14. -10. 
-14. -17. -13.-12. 4. 30. 66,104, 133-144-133. 104. 66. 30. 4.-12.-18.-17.-14.-10. 
-14.-18.-13.-11. 6. 3S. 73.113.144,156.144.113. 73. 3S . 6.-11,-18.-13.-14.-10. 
-14.-17,-13.-12. 4. 30. G6. 104.133.144.133.104. 66. 30. 4.-12, -IS. -17. -14, -10. 
[&[ -14.-17,-13.-14, -2- 19. 49* 80.104.113.104. 80. 49. 19. -2.-14,-13.-17.-14.-10. 

-12.-16.-18.-17. -9. 6. 27. 49, 66. 73. 66, 49, 27. 6. -9.-17,-18.-16.-12. -9. 
-11. -IS. -17. -18. -15. -7 . 6. 19 . 30 . 35 . 30, 19 . 6. -7 . "15 .-18 . -17.-15. -11 . "6. 
-9. -13. -IS. -18. -IS. -IS, -9. -2. 4. 6. 4. -2. -9.-15.-18.-18.-16,-13, -9. -fi. 
-S. -10. -14. -16. -18. -18, -17. -14. -12. »11. -12. -14. -17. -1S.-1S, -16. -14. -10. -8. -5. 
-6. -8.-11.-14.-16.-17.-18.-18.-18,-18,-18.-18.-18.-17.-16.-14.-11. -S. -6. -4. 
-4. -6. -3. -10. -13. -15. -16- -17,-17. -18. -17. -17. -16. -16. -13. -10. -8- -6. -4. -3. 
-3. -4. -6. -8. -9. -11. -12. -14. -14. -14. -14. -14. -12. -11. -9. -3. -G. -4. -3. -2. 
-2. -3, -4. -5. -6. -8, -9.-10.-10.-10.-10.-10. -9. -8. -6. -5, -4. -3, -2. -1 . 

> 



[H4] 




Q.00\ 5-00 



1500 ZO-OQ 



—594— 



